Screen Shot 2012-03-21 at 7.43.25 PM
I was really eager to find out more from Charles Franklin, Founder of PollsandVotes.com and the Director of the Marquette Law School Poll about online poll standards. As noted in my previous blog post, he paid JOUR4953 a visit this week.   Franklin had a good deal more than that to share and I believe that he brought our group a better understanding of the value of polling.  Much of it had to do with his enthusiasm and self-proclaimed "OCD" on the topic.  To highlight some problems with poll data reporting, Franklin mentioned a Time Magazine Poll on George W. Bush's approval ratings that really he said still "sticks in my craw!" His contention was that when you don't look at the aggregate data and only take the results from two points/dates, you not only miss the actual change, you use misleading data.  From his example, I was concerned with how I had been looking at and possibly misusing data.

Franklin's discussion flowed into why message control matters and why opinion polls matter.  Wording that pollsters use can mitigate or create bias.  Asking someone a question like "have you stopped beating your dog?" gives them no real choice.  Organizations that are paying for a poll may actually be anticipating the results they want and will framework the questions to meet their needs.  As he explained the finer points of polling needs, use and impact, I realized that the work went beyond writing questions. Analysis of polling data is a statistical nightmare, or dream-come-true if you like that kind of thing.  When Franklin was asked to define margin of error, he avoided giving us the formula above and kept it simple.  Consider doing the same poll 20 times, with a margin of error of 3 points, you would get the exact same results 19 times with only one resulting in a variance of 3.  I say, trust the experts.

Luckily, I was able to ask why Franklin said that online polling was still in an "R&D" phase.  His response required him to first explain that sampling is a proven statistical model, "You don't have to drink the whole pot of soup to make sure it'll taste good!"  Methodology also requires randomization and equal distribution, which he equated to stirring the pot of soup and grabbing a spoonful to sample.  Truly an effective way to explain something that is overly statistical. Phone polling participation has gone from 90% down to 20% in the past two decades, but still follows proven methodology. Online sampling will need to find a way to develop a statistical model that can prove accuracy from a non-random sample group. I'm glad he clarified, but I'm fully convinced that online polling will be the method of the future.  I am also certain that soup is in my future, too!
 
Screen Shot 2012-03-20 at 8.41.32 AM
Polling has an impact on a variety of industries.  My background in marketing and public relations has certainly required use of polls.  For online retailers a "fun" poll on their website creates an interaction with a visitor that has the potential for them to share the poll with friends.  These less sophisticated, entertainment type polls can also be used to create media buzz.  As noted in the New York Times polling standards, datal like this wouldn't be the model of accuracy, but it could be used in discussion and to bring some levity to the commentary.  Since 2000, BuyCostumes.com has been able to use this poll for mentions in national media with great success. 
 
While a poll regarding mask sales is interesting, political polls hold much higher requirements in the selection of their sample group, method of data collection and analysis for presentation of their findings.  While watching the presentation of the February 2012 "On the Issues: Marquette Law Poll" in class, my curiosity was piqued when Charles Franklin highlighted how wording impacts responses.  In the presentation, Franklin showed the question regarding iron-ore mining in Northern Wisconsin as posed by the Marquette Law Poll compared to the question the PPP used on the same issue.  The differences in wording enforced the responsibility of the poll conductor to remove bias and avoid inferring which answer is "right".  As a journalist, the level of insight into how a poll is conducted can also mean maintaining a high level of skepticism.  

To help avoid the use of lower quality polling data, most organizations set standards that exclude new media data collection.  In preparation for Franklin's visit to my JOUR4953 class, I was motivated by the February 15, 2012 post on his blog, PollsandVotes.com, "...a tremendous number of state polls are not reportable because they lack live interviewers, randomized in-household selection, and omit cell phones."  If an online poll can provide unbiased questions, target a legitimate sample and have a secure method of reporting, I agree with Franklin's position that new methods can be used as appropriate sources.  Clearly a retailer poll isn't where I would look to collect information to report on Super Tuesday's voting, but the option to refer to online polls shouldn't be eliminated.  Fewer and fewer people have landlines and of that number, many are unwilling to participate in polls.  With some enforceable standards and transparency into the collection methods, online polling will take a place as a valid resource.  

    Author

    Blogging for my JOUR4953 course at Marquette University focusing on the 2012 elections and the media.

    Archives

    April 2012
    March 2012
    February 2012
    January 2012

    View my profile on LinkedIn

    Categories

    All
    Charles Franklin
    Fear And Loathing On The Campaign Trail
    Inspiration
    Internet Marketing
    Jour4953
    Margin Of Error
    Nbc Embed
    Online Journalism
    Polling
    Rnc 2012
    Romney
    Social Media
    Soup
    Student Blogging
    Tampa Bay Times
    The Boys On The Bus

    RSS Feed